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1 Introduction 



B decays to charmonium-containing final states (J/V', ip{2S), Xci) K* are of interest for the precise 
measurement of sin 2/3, as for the similar decay B J/tpK^. Here, the final state consists of two 
vector particles, the K* meson and the charmonium meson : the L = 1 and L = 0, 2 states have 
different CP eigenvalues and the related dilution of any CP violation must be taken into account in 
the measurement of sin 2/3. The amplitude for longitudinal polarization of the two vector mesons is 
Aq. There are two amplitudes for polarizations of the vector mesons transverse to the decay axis: 
^11 for parallel polarization of the two vector mesons and A± for their perpendicular polarization. 
Only the relative amplitudes are measured here, so that l^oP + + = 1- Previous 

measurements of the amplitudes by the CLEO [1], CDF [2], BABAR [3] and Belle [4] collaborations 
for the B J/ipK* channels are all compatible with each other, and with a CP-odd intensity 
fraction \A±\'^ close to 0.2. 

Factorization is a framework that allows the description of heavy meson decays by assuming 
that a weak decay matrix element can be described as the product of two independent hadronic 
currents. In the case of heavy quarks present in the final state, the validity of the factorization 
hypothesis can be questioned. Factorization predicts that the phases of the decay amplitudes are 
the same (modulo tt). BABAR has observed [3, 5] a significant departure from this prediction. The 
factorization-suppressed decay B — > XcoK^ has also been observed [6, 7] with a branching fraction 
of the same order of magnitude as that of the factorization-allowed B XciK^ , while the decay 
to Xc2, predicted to have non-factorizable contributions comparable to those for decays to XcO [8], 
is actually not observed [9]. 

Precise measurements of the branching fractions of these decays arc now available [10] to test 
the theoretical description of the non-factorizable contributions [11], but polarization measurements 
are also needed. In particular measurements for ip{2S) and Xci, compared to that of J/tp , would 
discriminate the mass dependence from the quantum number dependence, due to the different 
effective Hamiltonian matrix element that describes charmonium production from vacuum under 
the factorization hypothesis, and to the different non-factorizable contributions [11]. CLEO has 
measured the longitudinal polarization of B —>■ iIj{2S) K* decays to be \Aq\^ = 0.45 ± 0.11 ± 0.04 
[12]. Belle has studied B Xci K* decays and obtained |yloP = 0.87 ± 0.09 ± 0.07 [13]. 

B decays to charmonium K^*'^ provide a clean environment for the measurement of CKM 
angles because one tree amplitude dominates the decay. Very small direct CP-violating charge 
asymmetries are expected in these decays : the observation of a sizeable, significant signal would 
be a smoking gun for the presence of new physics. No such signal has been found [10]. London et al. 
have suggested that several amplitudes with both different electro-weak phases and different strong 
phases must be present to create a charge asymmetry in a simple branching fraction measurement, 
while an angular analysis of vector- vector decays can detect charge asymmetries even in the case 
of vanishing strong phase difference [14]. Belle has looked for, and not found, such a signal [4]. 

In this paper we describe the amplitude measurement of B ^ (cc) K* with an angular analysis, 
for {cc)=J/tp, ip{2S) and Xci, using a selection similar to that of Ref. [10] and described below, 
and a fitting method similar to that of Ref. [3]. ^ candidates (any of the 1 charmonia; i.e. 
J/il) or V'(25')) are reconstructed in their decays to ££, where i represents an electron or a muon, 
and Xci candidates to J/ip^. Decays to the fiavor-eigenstates K'^tt^, K*^ —>■ Kgir"^ and 

vr^ are used. The relative strong phases are known to have a two-fold ambiguity when 
measured in an angular analysis alone. In contrast with earlier publications [1, 2, 5] we use here 
the set of phases predicted by Suzuki [15] using arguments based on the conservation of the s quark 
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helicity in the decay of the b quark. We have confirmed experimentally this prediction by the study 
of the variation with Kir invariant mass of the phase difference between the if* (892) amplitude 
and a non-resonant Ktt S-wave amplitude [3]. 

2 The BaBAR detector and dataset 

The data, collected with the BABML detector at the PEP-II asymmetric e+e" storage ring, represent 
232 million produced BB pairs, corresponding to an on-resonance integrated luminosity of about 
209 fb-\ 

The BABAR detector is described in detail elsewhere [16] . Charged-particle tracking is provided 
by a five-layer silicon vertex tracker (SVT) and a 40-layer drift chamber (DCH). For charged- 
particle identification (PID), ionization energy loss in the DCH and SVT, and Cherenkov radiation 
detected in a ring-imaging device (DIRC) are used. Photons are identified by the electromagnetic 
calorimeter (EMC), which comprises 6580 thallium-doped Csl crystals. These systems are mounted 
inside a 1.5-T solenoidal superconducting magnet. Muons are identified in the instrumented flux 
return (IFR), composed of resistive plate chambers and layers of iron that return the magnetic flux 
of the solenoid. 

We use the GEANT [17] software to simulate interactions of particles traversing the detector, 
taking into account the varying accelerator and detector conditions. 

3 Event Selection 

Event pre-selection is performed in the same way as in Ref. [10]. Multihadron events are selected 
by demanding a minimum of three reconstructed charged tracks in the polar-angle range 0.41 < 
6 < 2.54 rad, where 6 is defined in the laboratory frame. Charged tracks must be reconstructed in 
the DCH and are required to originate within 1.5 cm of the beam in the plane transverse to it and 
within 10 cm of the beamspot along the beam direction. Events are required to have a primary 
vertex within 0.5 cm of the average position of the interaction point in the plane transverse to 
the beamline, and within 6 cm longitudinally. Charged tracks are required to include at least 12 
DCH hits and to have a transverse momentum pT > 100 MeV/ c. Photon candidates arc required 
to have a minimum energy of 30 McV. to have a lateral energy profile compatible with that of an 
electromagnetic shower, and to be in the fiducial volume of the EMC, 0.41 < 9 < 2.41 rad. Electron 
candidates are selected using information from the EMC, the ratio of the energy measured in the 
EMC to the momentum measured by the tracking system, the energy loss in the drift chamber, 
and the Cherenkov angle mcasTircd in the DIRC. Electrons are also required to be in the fiducial 
volume 0.41 < 9 < 2.41 rad. Muon candidates are selected using information from the EMC (energy 
deposition consistent with a minimum ionizing particle) and the distribution of hits in the RPC. 
Muons are required to be in the fiducial volume 0.3 < 9 < 2.7 rad. We select charged kaon and pion 
candidates using information from the energy loss in the SVT and DCH, and the Cherenkov angle 
measured in the DIRC. Kaon candidates are required to be in the fiducial volume 0.45 < 9 < 2.45 
rad. 

B candidates are selected in a similar way as in Ref. [10]. The J/^p candidates are required to 
have an invariant mass 2.95 < "mg+e- < 3.14 GeV/c^ or 3.06 < m^+^- < 3.14 GeV/c^ for decays 
to e+e" and to fi^ iJi~ respectively. The '4'{2S) candidates are required to have invariant masses 
3.44 < rrie+e- < 3.74 GeV/c^ or 3.64 < m^+^- < 3.74 GeV/c^. Electron candidates are combined 
with photon candidates in order to recover some of the energy lost through bremsstrahlung. In the 
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Xci reconstruction, the associated 7 has to satisfy shower shape requirements and has to have an 
energy greater than 150 MeV. The Xci candidates are required to satisfy 350 < m^+£-^ — mi+i- < 
450 MeV/c^. The 7r° 77 candidates are required to satisfy 113 < m^^ < 153 MeV/c^. The 
energy of the soft photon has to be greater than 50 MeV, and the energy of the hard photon has to 
be greater than 150 MeV. The 7r+ 7r~ candidates are required to satisfy 489 < m^+^- < 507 

MeV/c^. In addition, the flight distance from the vertex must be larger than 3 standard 
deviations. The and K*+ candidates are required to satisfy 796 < rriKiT < 996 MeV/c^ and 
792 < rriKT^ < 992 McV/c^, respectively. In addition, due to the presence of a large background 
of low-energy non-genuine vr^'s, the cosine of the angle 6k* between the K momentum and the 
B momentum in the K* rest frame has to be less than 0.8 for K* —>■ K^ir^. For events which 
reconstruct to Ba — VK* and Bf, VK^ modes, with K* decaying to 7r° and decaying to tt"^, 
the Ba candidate is discarded, as vr^ vr" is observed to be the dominant source of cross-feed. 

The B candidates, reconstructed by combining charmonium and K* candidates, are charac- 
terized by two kinematic variables: the difference between the reconstructed energy of the B 
candidate and the beam energy in the center-of-mass frame AE = E*^ — -E^eom' ^^"^ beam 



energy-substituted mass mES) defined as mES = y ^leam ~ Ps ' where the asterisk refers to quan- 
tities in the center-of-mass and ps is the B momentum. For a correctly reconstructed B meson, 
AE is expected to peak at zero and the energy-substituted mass mss at the B meson mass, 5.279 
GeV/c^. Only one reconstructed B meson is allowed per event. For events that have multiple can- 
didates, the candidate having the smallest |A£^| is chosen. The analysis is performed in a region 
of the mES vs AE plane defined by 5.2 < tues < 5.3 GeV/c^ and -120 < AE < 120 MeV. The 
signal region is defined as rn-ES > 5.27 GeV/c^ and \AE\ smaller than 40 or 30 MeV for channels 
with or without a ir^ respectively. Figure 1 shows the ttt-es distributions for both data and Monte 
Carlo, within the AE signal region. 

4 Angular Analysis 

The B decay amplitudes are measured from the differential decay distribution, expressed in the 
transversity basis with angles {9K*,0tr,4>tr) defined as follows ([3, 5], Fig. 2) ^: 

• 9k* is the helicity angle of the K* decay. It is defined in the rest frame of the K* meson, and 
is the angle between the kaon and the opposite direction of the B meson in this frame; 

• 9tr and cptr are defined in the \I' (Xci) rest frame and are the polar and azimutal angle of the 
positive lepton {J/ip daughter of Xci) , with respect the axis defined by: 

— Xfr- opposite direction of the B meson; 

— y^j.: perpendicular to Xfr, in the {xtr,PK*) plane, with a direction such that pj^* -y^.^ > 0; 

— Ztr- to complete the frame, ie: Ztr = xu- x y^^.. 

In terms of the angular variables uj = {9k* ,9tr,(t>tr)-> the time-integrated differential decay rate for 
the decay of the B meson is 




1 



d-^r 



6 




(1) 



®The conventions regarding these frame definitions are detailed in [19, 20]. 
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Figure 1: mss distributions within the /S.E signal region. Prom top to bottom the rows represent the 

J/if) , ipi'^S) and Xci channel. From left to right, the columns represent the K*^{K'^tt~), K*'^ {K^tt'^) 
and K*^{K~^Tr^) channels. The points represent the data and the histograms represent the Monte 
Carlo. 
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Figure 2: Definition of the transversity angles. Details are given in the text. 



Table 1: Amplitude coefficients Ai and angular functions fi{uj), that contribute to the differential 

decay rate of a B meson. An overall normalization factor 9/327r (for ^) and 9/647r (for Xci) has 
been omitted. In the case of a i? decay, the 9m terms change sign. 



2 
3 
4 
5 



I An '2 



^m{A*A±) 



J,{u) for vl/ [3, 5] J,{u) for Xd [19] 

2 cos^ 9k* [l — sin^ Otr cos^ 0tr] 2 cos^ 9k* [l + sin^ 614^ cos^ 0^ 
ri .;„2fl ^;„2^ 1 sin2 6'ii-. [1 + sin2 6'frsin2,^t/ 

sin^ 2 cos^ 9tr + sin^ 
— sin^ 9k* sin 20^,. sin ^tr 
sin 20/<'* sin^ 6tr sin 2^^^ 
— sin 29k* sin 2^^^ cos (^^r 



sin^ ^ii-* [1 — sin^ 9tr sin^ 
sin^ ^i^* sin^ 9tr 
sin^ 0ft:* sin 29tr sin ^^j. 

- ^ sin 29k* sin^ ^tr sin 2^tr 
Y 

sin 20^* sin 29tr cos 



where the amplitude coefficients Ai and the angular functions fi{uj), i = 1 • • • 6 are listed in Table 1. 
The ^' decays to two spin-1/2 particles, while the Xci decays to two vector particles. The angular 
functions obtained are therefore different [19]. 

The symbol A denotes the transversity amplitudes for the decay of the B meson: A = 
(Aq, We denote by A the amplitudes for the B meson decay. In the absence of direct CP 

violation, we can choose a phase convention in which these amplitudes are related by Aq = +Ao, 
A|| = +A||, A± = —A±, so that A± is CP-odd and Aq and Ay are CP-even. The phases Sj of the 
amplitudes, where j = 0, ||, ±, are defined by Aj = \ Aj\e^^^ . Phases are defined relative to Sq = 0. 

5 Acceptance Correction 

We perform an unbinned likelihood fit of the three-dimensional angle PDF. The acceptance of the 
detector and the efficiency of the event reconstruction may vary as a function of the transversity 
angles, in particular as the angle 9k* is strongly correlated with the momentum of the final kaon 
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and pion. The PDF of the observed events, g""', is : 



/''^(u;;A)=5(a;;A)-^, (2) 

where g{uj\A) is given by Eq. (1), £(0;) is the angle-dependent acceptance, and 

{e){A)^ J 5(u;;AHa;)du; (3) 

is the average acceptance. The presence of cross-feed from the companion channels which have, 
as a consequence of isospin symmetry, the same A dependence as that of the signal, is taken into 
account. The observed PDF for channel b {b = K'^tt^ , Kgir"^ , K'^tt'^) is then 

gb,obs^^^^ = g{u;;A)^^^^ (4) 

ELi MAM 

E^{(jj) is the efficiency for reconstructed channel b considering B — > {cc)K* channels as a whole (for 
the three charmonium states separately), that is counting cross-feed events as signal. The ^\ are 
the /fc(a;) moments of the "whole" efficiency e^. The expressions for £^(c*;) and <t\ are available 
and discussed in section IV. A of Ref. [3]. 

The acceptance e^{oj) can be expressed as in Eq. (4), and only the coefficients are needed, 
under the approximations that the angular resolution can be neglected, including for cross-feed 
events, and that the double misidentification of the daughters of the K*'^ K^tt^ candidate {K- 
TT swap) can be neglected. The biases induced by these approximations have been estimated with 
Monte Carlo (MC) based studies, and found to be negligible (see table IV of [3]). 

The coefficients $^ are computed with exclusive signal MC samples obtained using a full simu- 
lation of the experiment [17, 21]. PID efficiencies measured with data control samples are used to 
adjust the MC simulation to the actual behavior of the detector. Separate coefficients are used for 
different charges of the final state mesons, in particular to take into account the charge dependence 
of the interaction of charged kaons with matter, and a possible charge asymmetry of the detector. 
Writing the expression for the log-likelihood L^{A) for the PDF g'''"''^ (uif, A) for a pure signal 
sample of Ns events, the relevant contribution is 

L\A) = In {giu^i-, A))-Ns In A(A)$^) , (5) 

i=l \ k / 

since the remaining term X^i^^i [e''{uJi)) does not depend on the amplitudes. 

6 Background Correction 

We use a background correction method described in section IV. B of Ref. [3], in which background 
events are added with a negative weight to the log-likelihood that is maximized 

riB+Ns ~ Nb 

L'^'iA)^ ^ ln(/'"^^(a;,;A))-^^ln(/'°''^(u,,;A)). (6) 
1=1 ^ k=i 

The fit is performed within the mss signal region (mES > 5.27GeV/c^) which contains Nb 
signal events, fls is an estimate of the unknown number ub oi background events that are present 
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in the signal region in the data sample. In Ref. [3] background events were estimated from the 
data by fitting the rriES distribution in the sideband region and extrapolating in the tties signal 
region. This method assumed that the background has only a combinatorial contribution and no 
peaking contribution. This is a valid argument for the J/ip channels, but not the "ip{2S) and Xci 
channels where peaking backgrounds are known to have a non-negligigle contribution. Therefore, 
in this analysis, the background (combinatorial and peaking) has been taken from generic MC. 
As L^' is not a log-likelihood, the uncertainties yielded by the minimization program Minuit [22] 
arc biased estimates of the actual uncertainties. An unbiased estimation of the uncertainties is 
described and validated in Appendix A of Ref. [3]. With this pscudo-log-likelihood technique, we 
avoid parametrizing the acceptance as well as the background angular distributions. 

7 Systematics 

The measurement is affected by several systematic uncertainties. The branching ratios that are 
used in the cross-feed part of the acceptance cross section are varied by itlcr, and the largest 
variation is retained. The uncertainty induced by the finite size of the MC sample used to compute 
the coefficients ^\ is estimated by the statistical uncertainty of the angular fit on that MC sample 
(shift additivity [5]). The uncertainty due to our limited understanding of the PID is estimated by 
using two different methods to correct for the MC-vs-data differences. The background uncertainty 
is obtained by comparing MC and data shapes of the mss distributions for the combinatorial 
component and by using the corresponding branching errors for the peaking component. The 
uncertainty due to the presence of a K-k S wave under the K*(892) peak is estimated by a fit 
including it. The differential decay rate is described by eqs. (6-9) of Reference [3]. 

8 Results 

The results are summarized in Table 2. The values of |^oP) l^lll^' I^J-I^ t° negatively 

correlated, as is expected for quantities the sum of which is unity. In particular, which 
would be the least precisely measured parameter in separate one-dimensional fits, is strongly anti- 
correlatcd with |Aop, which would be the best measured. The one-dimensional (ID) distributions, 
acceptance-corrected with an ID Ansatz ^ , and background-subtracted, are overlaid with the 
fit results and shown on figure 4. As in lower statistics studies, the cos Ok* forward backward 
asymmetry due to the interference with the S wave is clearly visible. 

Table 2: Summary of the amplitudes measured. In the case of decays to Xcij ^± is compatible 
with zero, and therefore its phase is not defined. 



Channel 




|A„P 




-511 


5x 


J/'ipK* 


0.556 ±0.009 ±0.010 


0.211 ± 0.010 ± 0.006 


0.23.3 ± 0.010 ± 0.005 


-2.93 ±0.08 ±0.04 


2.91 ± 0.05 ± 0.03 




0.48 ± 0.05 ± 0.02 


0.22 ±0.06 ±0.02 


0..30± 0.06 ±0.02 


-2.8 ±0.1 ±0.1 


2.8 ± 0.3 ± 0.1 




0.77 ± 0,07 ± 0.01 


0,20 ± 0,07 ± 0,01 


0.03 ± 0.01 ± 0.02 


0,0 ± 0.3 ± 0.1 





A graphical representation is given in Fig. 3. 

®In contrast with the dedicated method used in the fit, for the plots, we simply computed the ID efficiency maps 
fi-om the distributions of the accepted events divided by the ID PDF. 
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¥(2S) 



all 



5// ^1 



j/vp BaBar preliminary 



all 



0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 -6 -4 -2 2 4 6 

Amplitude Norm Amplitude Phase (rad) 

Figure 3: Data : Results of the fits. Left : norms (|j4o|^ in red, |^|j|^ in green), Right : phases (^y 
in blue, 6± in green). Circles vr^; Squares : vr"'"; Up triangles : vr*^, Down triangles : all 
K*^s combined. In the case of decays to Xci, ^± is compatible with zero, and therefore its phase 
is not defined, (the K~^7r^ contribution is removed in computing for Xci, as is compatible 

with zero). For each charmonium and each measurement, the results for the individual channels 
are shown together with the average. 



Table 3: Difference between the interference terms measured in B and B decays to J/ip . 





{K+TT-) 


(i^+vr") 




6A4, 


0.002 ± 0.025 ± 0.005 


-0.017 ± 0.047 ± 0.023 


-0.008 ±0.049 ±0.011 


5Aq 


-0.011 ±0.043 ±0.016 


-0.051 ± 0.098 ± 0.064 


0.075 ± 0.089 ± 0.009 
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BaBar Preliminary BaBar Preliminary 

KV K^Tt* kV K*ii' K^ti* kV 




2.5 5 2.5 5 2.5 



K K 

Figure 4: Angular distributions with PDF from fit overlaid. The asymmetry of the cos 9k* distri- 
butions induced by the S-wave inteference is clearly visible. 
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In summary, 

• Our measurement of the amplitudes of B decays to J/ip are compatible with, and of better 
precision than, previous measurements. 

• Prom a comparison of B'^ and B~^ decays, isospin is seen to be conserved in the decay. 

• We confirm our previous observation that the strong phase differences are significantly dif- 
ferent from zero, in contrast with what is predicted by factorization. For B — > J/tpK*, it 
amounts to - 5± = 0.45 ± 0.05 ± 0.02, an 8a effect. 

• The presence of direct CP-violating triple-products in the amplitude would produce a S to 
B difference in the interference terms Ai and .46 : SAi and 6 As- This is not observed as all 
the measurement are compatible with zero (see Table 3), with an improved precision with 
respect to the BELLE measurement [23] . 

• We have performed the first three-dimensional analysis of the decays to ip{2S) and Xci- The 
longitudinal polarization of the decay to il^{2S) is smaller than that of the J/il^ , while the CP- 
odd intensity fraction of the two decays arc similar. This is compatible with the prediction 
of models of meson decays in the framework of factorization. 

The longitudinal polarization of the decay to Xci is found to be larger than that to J/ip , in 
contrast with the predictions of Ref. [11] which include non-factorizable contributions. The 
CP-odd intensity fraction of this decay is compatible with zero. The phases of the parallel 
and of the longitudinal amplitudes are observed to be compatible with each other, in contrast 
with decays to ^. 
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